2026-10-27 17:59:39,306 [ 290913 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy (runner:42, check_args_and_update_paths)
2026-10-27 17:59:39,306 [ 290913 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:90, check_args_and_update_paths)
2026-10-27 17:59:39,306 [ 290913 ] INFO : src dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/src (runner:97, check_args_and_update_paths)
2026-10-27 17:59:39,306 [ 290913 ] INFO : base_configs_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration  (runner:99, check_args_and_update_paths)
2026-10-27 17:59:39,306 [ 290913 ] INFO : Unknown image altinityinfra/dotnet-client (runner:357, <module>)
Running pytest container as: 'docker run   --rm --name clickhouse_integration_tests_zp8ssq --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=1864 -e DOCKER_BASE_TAG=1864 -e DOCKER_KERBERIZED_HADOOP_TAG=1864 -e DOCKER_KERBEROS_KDC_TAG=1864 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=1864 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=1864 -e DOCKER_MYSQL_JS_CLIENT_TAG=1864 -e DOCKER_MYSQL_PHP_CLIENT_TAG=1864 -e DOCKER_NGINX_DAV_TAG=1864 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=1864   -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600  -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]'  -vvv" altinityinfra/integration-tests-runner:1864 '.
Start tests
============================= test session starts ==============================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.7.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /ClickHouse/tests/integration
configfile: pytest.ini
plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, xdist-3.5.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
created: 5/5 workers
5 workers [1 item]

scheduling tests via LoadFileScheduling

test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] 
[gw0] [100%] FAILED test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] 

=================================== FAILURES ===================================
_______________ test_s3_disk_reads_on_unstable_connection[node] ________________
[gw0] linux -- Python 3.10.12 /usr/bin/python3

cluster = <helpers.cluster.ClickHouseCluster object at 0x7f0295f5a080>
node_name = 'node'

    @pytest.mark.parametrize("node_name", ["node"])
    def test_s3_disk_reads_on_unstable_connection(cluster, node_name):
        node = cluster.instances[node_name]
        create_table(node, "s3_test", storage_policy="unstable_s3")
>       node.query(
            "INSERT INTO s3_test SELECT today(), *, toString(*) FROM system.numbers LIMIT 9000000"
        )

test_merge_tree_s3/test.py:685: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:3424: in query
    return self.client.query(
helpers/client.py:36: in wrap
    return func(self, *args, **kwargs)
helpers/client.py:74: in query
    ).get_answer()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <helpers.client.CommandRequest object at 0x7f0295e7f820>

    def get_answer(self):
        self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT)
        self.stdout_file.seek(0)
        self.stderr_file.seek(0)
    
        stdout = self.stdout_file.read().decode("utf-8", errors="replace")
        stderr = self.stderr_file.read().decode("utf-8", errors="replace")
    
        if (
            self.timer is not None
            and not self.process_finished_before_timeout
            and not self.ignore_error
        ):
            logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}")
            raise QueryTimeoutExceedException("Client timed out!")
    
        if (
            self.process.returncode != 0 or self.remove_trash_from_stderr(stderr)
        ) and not self.ignore_error:
>           raise QueryRuntimeException(
                "Client failed! Return code: {}, stderr: {}".format(
                    self.process.returncode, stderr
                ),
                self.process.returncode,
                stderr,
            )
E           helpers.client.QueryRuntimeException: Client failed! Return code: 243, stderr: Received exception from server (version 23.8.16):
E           Code: 499. DB::Exception: Received from 172.16.1.6:9000. DB::Exception: Message: Poco::Exception. Code: 1000, e.code() = 0, Timeout (version 23.8.16.43.altinitystable (altinity build)), bucket root, key data/xuz/abyktrndavhsfpuvimpasodlzfosu, object size 4289700. Stack trace:
E           
E           0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c5d7957 in /usr/bin/clickhouse
E           1. DB::S3Exception::S3Exception<String const&, String const&, String const&, unsigned long&>(Aws::S3::S3Errors, fmt::v8::basic_format_string<char, fmt::v8::type_identity<String const&>::type, fmt::v8::type_identity<String const&>::type, fmt::v8::type_identity<String const&>::type, fmt::v8::type_identity<unsigned long&>::type>, String const&, String const&, String const&, unsigned long&) @ 0x0000000011017cd7 in /usr/bin/clickhouse
E           2. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000001102b384 in /usr/bin/clickhouse
E           3. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::WriteBufferFromS3::TaskTracker::add(std::function<void ()>&&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x0000000011030936 in /usr/bin/clickhouse
E           4. std::__packaged_task_func<std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunner<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority)::'lambda'(), std::allocator<std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunner<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority)::'lambda'()>, void ()>::operator()() @ 0x000000001100535a in /usr/bin/clickhouse
E           5. std::packaged_task<void ()>::operator()() @ 0x0000000010ac62cf in /usr/bin/clickhouse
E           6. ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x000000000c6b657e in /usr/bin/clickhouse
E           7. void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000000c6ba03c in /usr/bin/clickhouse
E           8. void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000000c6b8884 in /usr/bin/clickhouse
E           9. ? @ 0x00007f8fd5b48a83 in ?
E           10. ? @ 0x00007f8fd5bda8e0 in ?
E           . (S3_ERROR)
E           (query: INSERT INTO s3_test SELECT today(), *, toString(*) FROM system.numbers LIMIT 9000000)

helpers/client.py:239: QueryRuntimeException
---------------------------- Captured stdout setup -----------------------------
Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml
Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml
---------------------------- Captured stderr setup -----------------------------
WARNING: API is accessible on http://0.0.0.0:2375 without encryption.
         Access to the remote API is equivalent to root access on the host. Refer
         to the 'Docker daemon attack surface' section in the documentation for
         more information: https://docs.docker.com/go/attack-surface/
WARNING: API is accessible on http://0.0.0.0:2375 without encryption.
         Access to the remote API is equivalent to root access on the host. Refer
         to the 'Docker daemon attack surface' section in the documentation for
         more information: https://docs.docker.com/go/attack-surface/
------------------------------ Captured log setup ------------------------------
2026-10-27 17:59:43 [ 357 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:105, run_and_check)
2026-10-27 17:59:43 [ 357 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check)
2026-10-27 17:59:43 [ 357 ] DEBUG : No running containers (conftest.py:60, cleanup_environment)
2026-10-27 17:59:43 [ 357 ] DEBUG : Pruning Docker networks (conftest.py:62, cleanup_environment)
2026-10-27 17:59:43 [ 357 ] DEBUG : Command:['docker network prune --force'] (cluster.py:105, run_and_check)
2026-10-27 17:59:43 [ 357 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:105, run_and_check)
2026-10-27 17:59:43 [ 357 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:113, run_and_check)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                  DOCKER_KERBEROS_KDC_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV         CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                             MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                        JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                             TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                 HOSTNAME 7970d9fe2753 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                    SHLVL 0 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                     HOME /root (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                   OLDPWD / (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                        DOCKER_HELPER_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                         PYTHONUNBUFFERED 1 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                            UBSAN_OPTIONS print_stacktrace=1 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                           PYTEST_ADDOPTS --dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]'  -vvv (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV    CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                     COMPOSE_HTTP_TIMEOUT 600 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV              DOCKER_MYSQL_PHP_CLIENT_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                 DOCKER_DOTNET_CLIENT_TAG latest (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV         CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV               DOCKER_MYSQL_JS_CLIENT_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                     PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV             DOCKER_KERBERIZED_HADOOP_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                           DOCKER_CHANNEL stable (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                    DOCKER_CLIENT_TIMEOUT 300 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV        DOCKER_POSTGRESQL_JAVA_CLIENT_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                     DOCKER_NGINX_DAV_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV           DOCKER_MYSQL_GOLANG_CLIENT_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                      PWD /ClickHouse/tests/integration (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV             DOCKER_MYSQL_JAVA_CLIENT_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV       CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV         CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                       TZ Etc/UTC (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                          DOCKER_BASE_TAG 1864 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                               SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                                 LC_CTYPE C.UTF-8 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                 INTEGRATION_TESTS_RUN_ID 1 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                  PYTEST_XDIST_TESTRUNUID 796542072c1f42359aba1127ce744caf (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                      PYTEST_XDIST_WORKER gw0 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                PYTEST_XDIST_WORKER_COUNT 5 (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : ENV                      PYTEST_CURRENT_TEST test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node] (setup) (cluster.py:343, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:636, __init__)
2026-10-27 17:59:43 [ 357 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1629, add_instance)
2026-10-27 17:59:43 [ 357 ] DEBUG : Cluster name: project_name:roottestmergetrees3. Added instance name:node tag:1864 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml', '--file', '/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/compose (cluster.py:1915, add_instance)
2026-10-27 17:59:43 [ 357 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1629, add_instance)
2026-10-27 17:59:43 [ 357 ] DEBUG : Cluster name: project_name:roottestmergetrees3. Added instance name:node_with_limited_disk tag:1864 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml', '--file', '/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/docker-compose.yml'] docker_compose_yml_dir:/compose (cluster.py:1915, add_instance)
2026-10-27 17:59:43 [ 357 ] INFO : Starting cluster... (test.py:47, cluster)
2026-10-27 17:59:43 [ 357 ] INFO : Running tests in /ClickHouse/tests/integration/test_merge_tree_s3/test.py (cluster.py:2637, start)
2026-10-27 17:59:43 [ 357 ] DEBUG : Cluster start called. is_up=False (cluster.py:2644, start)
2026-10-27 17:59:43 [ 357 ] DEBUG : !!! Docker info: Client: Docker Engine - Community
 Version:    29.9.2
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.38.1
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v5.6.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 41
 Server Version: 23.0.6
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51
 runc version: v1.5.2-0-g29dd3dc2
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.0-130-generic
 Operating System: Ubuntu 22.04.5 LTS (containerized)
 OSType: linux
 Architecture: x86_64
 CPUs: 16
 Total Memory: 30.59GiB
 Name: 7970d9fe2753
 ID: 46b97c99-7c10-4b47-8770-06172c974321
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  65.108.242.32:5000
  127.0.0.0/8
 Registry Mirrors:
  http://65.108.242.32:5000/
 Live Restore Enabled: false
 Default Address Pools:
   Base: 172.17.0.0/12, Size: 24

 (cluster.py:722, print_all_docker_pieces)
2026-10-27 17:59:43 [ 357 ] DEBUG : Docker networks for project roottestmergetrees3 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:733, print_all_docker_pieces)
2026-10-27 17:59:43 [ 357 ] DEBUG : Docker containers for project roottestmergetrees3 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:741, print_all_docker_pieces)
2026-10-27 17:59:43 [ 357 ] DEBUG : Docker volumes for project roottestmergetrees3 are DRIVER    VOLUME NAME
 (cluster.py:749, print_all_docker_pieces)
2026-10-27 17:59:43 [ 357 ] DEBUG : Cleanup called (cluster.py:754, cleanup)
2026-10-27 17:59:43 [ 357 ] DEBUG : !!! Docker info: Client: Docker Engine - Community
 Version:    29.9.2
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.38.1
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v5.6.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 41
 Server Version: 23.0.6
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51
 runc version: v1.5.2-0-g29dd3dc2
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.0-130-generic
 Operating System: Ubuntu 22.04.5 LTS (containerized)
 OSType: linux
 Architecture: x86_64
 CPUs: 16
 Total Memory: 30.59GiB
 Name: 7970d9fe2753
 ID: 46b97c99-7c10-4b47-8770-06172c974321
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  65.108.242.32:5000
  127.0.0.0/8
 Registry Mirrors:
  http://65.108.242.32:5000/
 Live Restore Enabled: false
 Default Address Pools:
   Base: 172.17.0.0/12, Size: 24

 (cluster.py:722, print_all_docker_pieces)
2026-10-27 17:59:43 [ 357 ] DEBUG : Docker networks for project roottestmergetrees3 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:733, print_all_docker_pieces)
2026-10-27 17:59:43 [ 357 ] DEBUG : Docker containers for project roottestmergetrees3 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:741, print_all_docker_pieces)
2026-10-27 17:59:44 [ 357 ] DEBUG : Docker volumes for project roottestmergetrees3 are DRIVER    VOLUME NAME
 (cluster.py:749, print_all_docker_pieces)
2026-10-27 17:59:44 [ 357 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check)
2026-10-27 17:59:44 [ 357 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup)
2026-10-27 17:59:44 [ 357 ] DEBUG : No running containers for project: roottestmergetrees3 (cluster.py:782, cleanup)
2026-10-27 17:59:44 [ 357 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup)
2026-10-27 17:59:44 [ 357 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup)
2026-10-27 17:59:44 [ 357 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check)
2026-10-27 17:59:44 [ 357 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check)
2026-10-27 17:59:44 [ 357 ] DEBUG : Images pruned (cluster.py:807, cleanup)
2026-10-27 17:59:44 [ 357 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup)
2026-10-27 17:59:44 [ 357 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check)
2026-10-27 17:59:44 [ 357 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check)
2026-10-27 17:59:44 [ 357 ] DEBUG : Setup directory for instance: node (cluster.py:2657, start)
2026-10-27 17:59:44 [ 357 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/bg_processing_pool_conf.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/configs/config.d (cluster.py:4383, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/database (cluster.py:4400, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/logs (cluster.py:4411, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4487, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Setup directory for instance: node_with_limited_disk (cluster.py:2657, start)
2026-10-27 17:59:44 [ 357 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/storage_conf.xml', '/ClickHouse/tests/integration/test_merge_tree_s3/configs/config.d/bg_processing_pool_conf.xml'] to /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/configs/config.d (cluster.py:4383, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/database (cluster.py:4400, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/logs (cluster.py:4411, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4487, create_dir)
2026-10-27 17:59:44 [ 357 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env (cluster.py:78, _create_env_file)
2026-10-27 17:59:44 [ 357 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file)
2026-10-27 17:59:44 [ 357 ] DEBUG : No config file found (config.py:28, find_config_file)
2026-10-27 17:59:44 [ 357 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file)
2026-10-27 17:59:44 [ 357 ] DEBUG : No config file found (config.py:28, find_config_file)
2026-10-27 17:59:44 [ 357 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:546, _make_request)
2026-10-27 17:59:44 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml', '--file', '/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/docker-compose.yml', 'pull'] (cluster.py:105, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy2                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling minio1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node                   ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node_with_limited_disk ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling resolver               ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling resolver               ... pulling from altinityinfra/python... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy2                 ... pulling from altinityinfra/s3-proxy (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling resolver               ... digest: sha256:5a7a0ebe149009e702... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling resolver               ... status: image is up to date for a... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy2                 ... digest: sha256:1a92e43060168b5557... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy2                 ... status: image is up to date for a... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling resolver               ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy2                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy1                 ... pulling from altinityinfra/s3-proxy (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy1                 ... digest: sha256:1a92e43060168b5557... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy1                 ... status: image is up to date for a... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node_with_limited_disk ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling proxy1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node_with_limited_disk ... digest: sha256:45997363e17ff1831d... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node_with_limited_disk ... status: image is up to date for a... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node_with_limited_disk ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling minio1                 ... pulling from clickhouse/minio-minio (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling minio1                 ... digest: sha256:9eea83a4e1425067e7... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling minio1                 ... status: image is up to date for c... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling minio1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node                   ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node                   ... digest: sha256:45997363e17ff1831d... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node                   ... status: image is up to date for a... (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] DEBUG : Stderr:Pulling node                   ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:05 [ 357 ] INFO : Trying to create Minio instance by command docker-compose --env-file /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env --project-name roottestmergetrees3 --file /compose/docker_compose_minio.yml --verbose up -d (cluster.py:2938, start)
2026-10-27 18:00:05 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/compose/docker_compose_minio.yml', '--verbose', 'up', '-d'] (cluster.py:105, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.config.config.find: Using configuration files: /compose/docker_compose_minio.yml (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.docker_client.get_client: docker-compose version 1.29.2, build unknown (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:docker-py version: <module 'docker.version' from '/usr/local/lib/python3.10/dist-packages/docker/version.py'> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:CPython version: 3.10.12 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:OpenSSL version: OpenSSL 3.0.2 15 Mar 2022 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker base_url: http+docker://localhost (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker version: Platform={'Name': 'Docker Engine - Community'}, Components=[{'Name': 'Engine', 'Version': '23.0.6', 'Details': {'ApiVersion': '1.42', 'Arch': 'amd64', 'BuildTime': '2023-05-05T21:18:13.000000000+00:00', 'Experimental': 'false', 'GitCommit': '9dbdbd4', 'GoVersion': 'go1.19.9', 'KernelVersion': '5.15.0-130-generic', 'MinAPIVersion': '1.12', 'Os': 'linux'}}, {'Name': 'containerd', 'Version': 'v2.4.2', 'Details': {'GitCommit': 'b7a25261e029d68978bbf290df0a62fc819b3c51'}}, {'Name': 'runc', 'Version': '1.5.2', 'Details': {'GitCommit': 'v1.5.2-0-g29dd3dc2'}}, {'Name': 'docker-init', 'Version': '0.19.0', 'Details': {'GitCommit': 'de40ad0'}}], Version=23.0.6, ApiVersion=1.42, MinAPIVersion=1.12, GitCommit=9dbdbd4, GoVersion=go1.19.9, Os=linux, Arch=amd64, KernelVersion=5.15.0-130-generic, BuildTime=2023-05-05T21:18:13.000000000+00:00 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestmergetrees3_default') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_volume <- ('roottestmergetrees3_data1-1') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info <- () (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info -> {'Architecture': 'x86_64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'BridgeNfIp6tables': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'BridgeNfIptables': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'CPUSet': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'CPUShares': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'CgroupDriver': 'cgroupfs', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'CgroupVersion': '2', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'ContainerdCommit': {'Expected': 'b7a25261e029d68978bbf290df0a62fc819b3c51', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:                      'ID': 'b7a25261e029d68978bbf290df0a62fc819b3c51'}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Containers': 0, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestmergetrees3_default') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.network.ensure: Creating network "roottestmergetrees3_default" with the default driver (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network <- (name='roottestmergetrees3_default', driver=None, options=None, ipam=None, internal=False, enable_ipv6=False, labels={'com.docker.compose.project': 'roottestmergetrees3', 'com.docker.compose.network': 'default', 'com.docker.compose.version': '1.29.2'}, attachable=True, check_duplicate=True) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network -> {'Id': '3d13fcbdc67a2343fe5a375859de52bbc0deb1425eb249f50e76a4912500026c', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Warning': ''} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_volume <- ('roottestmergetrees3_data1-1') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.volume.initialize: Creating volume "roottestmergetrees3_data1-1" with default driver (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_volume <- ('roottestmergetrees3_data1-1', None, None, labels={'com.docker.compose.project': 'roottestmergetrees3', 'com.docker.compose.volume': 'data1-1', 'com.docker.compose.version': '1.29.2'}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_volume -> {'CreatedAt': '2026-10-27T18:00:06Z', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Driver': 'local', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Labels': {'com.docker.compose.project': 'roottestmergetrees3', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'com.docker.compose.version': '1.29.2', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'com.docker.compose.volume': 'data1-1'}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Mountpoint': '/var/lib/docker/volumes/roottestmergetrees3_data1-1/_data', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Name': 'roottestmergetrees3_data1-1', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Options': None, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Scope': 'local'} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/s3-proxy') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/s3-proxy') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('clickhouse/minio-minio:RELEASE.2024-07-31T05-46-26Z') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['minio'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/usr/bin/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/python-bottle') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['python3'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': None, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Env': ['PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.project._get_convergence_plans: minio1 has upstream changes (proxy1, proxy2) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'status': ['created', 'exited'], 'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'status': ['created', 'exited'], 'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.project._get_convergence_plans: resolver has upstream changes (proxy1, proxy2) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'status': ['created', 'exited'], 'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'status': ['created', 'exited'], 'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: proxy2>, <Service: resolver>, <Service: proxy1>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for <Service: proxy2> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for <Service: proxy1> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=proxy1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_proxy2_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestmergetrees3', service='proxy2', number=1)} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestmergetrees3', service='proxy2', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/s3-proxy') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_proxy1_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestmergetrees3', service='proxy1', number=1)} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestmergetrees3', service='proxy1', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/s3-proxy') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/s3-proxy') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 69464aa63230d7cf98c2854eb356d2271008cdcc3ed2260f60c6940b4fa24b37 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestmergetrees3_default', devices=None, device_requests=None, dns=None, dns_opt=None, dns_search=None, restart_policy=None, runtime=None, cap_add=None, cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=None, ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=None, device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'NetworkMode': 'roottestmergetrees3_default', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'PortBindings': {}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'VolumesFrom': []} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (image='altinityinfra/s3-proxy', volumes={}, name='roottestmergetrees3_proxy2_1', detach=True, ports=['8080', '80', '443'], environment=[], labels={'com.docker.compose.project': 'roottestmergetrees3', 'com.docker.compose.service': 'proxy2', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_minio.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '69464aa63230d7cf98c2854eb356d2271008cdcc3ed2260f60c6940b4fa24b37'}, host_config={'NetworkMode': 'roottestmergetrees3_default', 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}}, networking_config={'EndpointsConfig': {'roottestmergetrees3_default': {'Aliases': ['proxy2'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/s3-proxy') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 69464aa63230d7cf98c2854eb356d2271008cdcc3ed2260f60c6940b4fa24b37 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestmergetrees3_default', devices=None, device_requests=None, dns=None, dns_opt=None, dns_search=None, restart_policy=None, runtime=None, cap_add=None, cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=None, ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=None, device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'NetworkMode': 'roottestmergetrees3_default', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'PortBindings': {}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'VolumesFrom': []} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (image='altinityinfra/s3-proxy', volumes={}, name='roottestmergetrees3_proxy1_1', detach=True, ports=['8080', '80', '443'], environment=[], labels={'com.docker.compose.project': 'roottestmergetrees3', 'com.docker.compose.service': 'proxy1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_minio.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '69464aa63230d7cf98c2854eb356d2271008cdcc3ed2260f60c6940b4fa24b37'}, host_config={'NetworkMode': 'roottestmergetrees3_default', 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}}, networking_config={'EndpointsConfig': {'roottestmergetrees3_default': {'Aliases': ['proxy1'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'aebea87e3bd573e54784c325dd29846b91c51a6dcd5b2350f0b558905a1b82e9', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Warnings': ["The requested image's platform (linux/arm64/v8) does not match " (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:              'the detected host platform (linux/amd64/v4) and no specific ' (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:              'platform was requested']} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('aebea87e3bd573e54784c325dd29846b91c51a6dcd5b2350f0b558905a1b82e9') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '27333143b0936813b82c66bd28b55676e66f2e0db7ebbba151c0c87c4fb65ff9', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Warnings': ["The requested image's platform (linux/arm64/v8) does not match " (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:              'the detected host platform (linux/amd64/v4) and no specific ' (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:              'platform was requested']} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('27333143b0936813b82c66bd28b55676e66f2e0db7ebbba151c0c87c4fb65ff9') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Args': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Env': ['PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:                    'NGINX_VERSION=1.31.8', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('aebea87e3bd573e54784c325dd29846b91c51a6dcd5b2350f0b558905a1b82e9', 'roottestmergetrees3_default') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Args': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['/run.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Env': ['PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:                    'NGINX_VERSION=1.31.8', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('27333143b0936813b82c66bd28b55676e66f2e0db7ebbba151c0c87c4fb65ff9', 'roottestmergetrees3_default') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('aebea87e3bd573e54784c325dd29846b91c51a6dcd5b2350f0b558905a1b82e9', 'roottestmergetrees3_default', aliases=['aebea87e3bd5', 'proxy2'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('27333143b0936813b82c66bd28b55676e66f2e0db7ebbba151c0c87c4fb65ff9', 'roottestmergetrees3_default', aliases=['proxy1', '27333143b093'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('aebea87e3bd573e54784c325dd29846b91c51a6dcd5b2350f0b558905a1b82e9') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('27333143b0936813b82c66bd28b55676e66f2e0db7ebbba151c0c87c4fb65ff9') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestmergetrees3', service='proxy2', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_proxy2_1 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: <Service: proxy2> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestmergetrees3', service='proxy1', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_proxy1_1 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: <Service: proxy1> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {<Service: minio1>, <Service: resolver>} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for <Service: minio1> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for <Service: resolver> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=minio1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestmergetrees3', 'com.docker.compose.service=resolver', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_minio1_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestmergetrees3', service='minio1', number=1)} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestmergetrees3', service='minio1', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_resolver_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestmergetrees3', service='resolver', number=1)} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestmergetrees3', service='resolver', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/python-bottle') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('clickhouse/minio-minio:RELEASE.2024-07-31T05-46-26Z') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['python3'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': None, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Env': ['PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/python-bottle') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['minio'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/usr/bin/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('clickhouse/minio-minio:RELEASE.2024-07-31T05-46-26Z') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'arm64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['python3'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': None, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Env': ['PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: b63ae4ac0bd52b68b87e99c0a2e9c7944503b12c70558143d12d27a9f48f2fa0 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestmergetrees3_default', devices=None, device_requests=None, dns=None, dns_opt=None, dns_search=None, restart_policy=None, runtime=None, cap_add=None, cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=None, ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=None, device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'NetworkMode': 'roottestmergetrees3_default', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'PortBindings': {}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'VolumesFrom': []} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (image='altinityinfra/python-bottle', tty=True, volumes={}, name='roottestmergetrees3_resolver_1', detach=True, ports=['8080'], environment=[], labels={'com.docker.compose.project': 'roottestmergetrees3', 'com.docker.compose.service': 'resolver', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_minio.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'b63ae4ac0bd52b68b87e99c0a2e9c7944503b12c70558143d12d27a9f48f2fa0'}, host_config={'NetworkMode': 'roottestmergetrees3_default', 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}}, networking_config={'EndpointsConfig': {'roottestmergetrees3_default': {'Aliases': ['resolver'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['minio'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': ['/usr/bin/docker-entrypoint.sh'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: f96a516bbb371c59cc2dee5f7f949f3642c8704a045caa2cf8dba622b3fd2b18 (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=['/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/minio/certs:/certs:rw', 'roottestmergetrees3_data1-1:/data1:rw'], volumes_from=[], privileged=False, network_mode='roottestmergetrees3_default', devices=None, device_requests=None, dns=None, dns_opt=None, dns_search=None, restart_policy=None, runtime=None, cap_add=None, cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=None, ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=None, device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': ['/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/minio/certs:/certs:rw', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:           'roottestmergetrees3_data1-1:/data1:rw'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'NetworkMode': 'roottestmergetrees3_default', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'PortBindings': {}, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'VolumesFrom': []} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (command='server --console-address 127.0.0.1:19001 --address :9001 --certs-dir /certs /data1-1', environment=['MINIO_ACCESS_KEY=minio', 'MINIO_SECRET_KEY=minio123', 'MINIO_PROMETHEUS_AUTH_TYPE=public'], image='clickhouse/minio-minio:RELEASE.2024-07-31T05-46-26Z', volumes={'/certs': {}, '/data1': {}}, name='roottestmergetrees3_minio1_1', detach=True, ports=['9001'], labels={'com.docker.compose.project': 'roottestmergetrees3', 'com.docker.compose.service': 'minio1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_minio.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'f96a516bbb371c59cc2dee5f7f949f3642c8704a045caa2cf8dba622b3fd2b18'}, host_config={'NetworkMode': 'roottestmergetrees3_default', 'VolumesFrom': [], 'Binds': ['/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/minio/certs:/certs:rw', 'roottestmergetrees3_data1-1:/data1:rw'], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}}, networking_config={'EndpointsConfig': {'roottestmergetrees3_default': {'Aliases': ['minio1'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '359b70a35356b1d28696ae915c575d1b590cabd25f4c6e8a703a4cde5eae2a9e', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Warnings': ["The requested image's platform (linux/arm64/v8) does not match " (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:              'the detected host platform (linux/amd64/v4) and no specific ' (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:              'platform was requested']} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('359b70a35356b1d28696ae915c575d1b590cabd25f4c6e8a703a4cde5eae2a9e') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '87f2d4b341ddb032e4876b6c6f4e2708974fb1fcc451999418aef29ca7afe32f', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('87f2d4b341ddb032e4876b6c6f4e2708974fb1fcc451999418aef29ca7afe32f') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Args': [], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdin': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'AttachStdout': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Cmd': ['python3'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Domainname': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Entrypoint': None, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:            'Env': ['PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:                    'LANG=C.UTF-8', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('359b70a35356b1d28696ae915c575d1b590cabd25f4c6e8a703a4cde5eae2a9e', 'roottestmergetrees3_default') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Args': ['server', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          '--console-address', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          '127.0.0.1:19001', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          '--address', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          ':9001', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          '--certs-dir', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          '/certs', (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:          '/data1-1'], (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:... (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('87f2d4b341ddb032e4876b6c6f4e2708974fb1fcc451999418aef29ca7afe32f', 'roottestmergetrees3_default') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('359b70a35356b1d28696ae915c575d1b590cabd25f4c6e8a703a4cde5eae2a9e', 'roottestmergetrees3_default', aliases=['359b70a35356', 'resolver'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('87f2d4b341ddb032e4876b6c6f4e2708974fb1fcc451999418aef29ca7afe32f', 'roottestmergetrees3_default', aliases=['87f2d4b341dd', 'minio1'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('359b70a35356b1d28696ae915c575d1b590cabd25f4c6e8a703a4cde5eae2a9e') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('87f2d4b341ddb032e4876b6c6f4e2708974fb1fcc451999418aef29ca7afe32f') (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestmergetrees3', service='resolver', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_resolver_1 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: <Service: resolver> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestmergetrees3', service='minio1', number=1) (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_minio1_1   ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: <Service: minio1> (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check)
2026-10-27 18:00:08 [ 357 ] INFO : Trying to connect to Minio... (cluster.py:2944, start)
2026-10-27 18:00:08 [ 357 ] DEBUG : get_instance_ip instance_name=minio1 (cluster.py:1971, get_instance_ip)
2026-10-27 18:00:08 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestmergetrees3_minio1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:08 [ 357 ] DEBUG : get_instance_ip instance_name=proxy1 (cluster.py:1971, get_instance_ip)
2026-10-27 18:00:08 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestmergetrees3_proxy1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:08 [ 357 ] DEBUG : Starting new HTTP connection (1): 172.16.1.5:9001 (connectionpool.py:244, _new_conn)
2026-10-27 18:00:08 [ 357 ] DEBUG : Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment)
2026-10-27 18:00:08 [ 357 ] WARNING : Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0295e7d090>: Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:871, urlopen)
2026-10-27 18:00:08 [ 357 ] DEBUG : Starting new HTTP connection (2): 172.16.1.5:9001 (connectionpool.py:244, _new_conn)
2026-10-27 18:00:08 [ 357 ] DEBUG : Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment)
2026-10-27 18:00:08 [ 357 ] WARNING : Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0295e7d2d0>: Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:871, urlopen)
2026-10-27 18:00:08 [ 357 ] DEBUG : Starting new HTTP connection (3): 172.16.1.5:9001 (connectionpool.py:244, _new_conn)
2026-10-27 18:00:08 [ 357 ] DEBUG : Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment)
2026-10-27 18:00:08 [ 357 ] WARNING : Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0295e7d510>: Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:871, urlopen)
2026-10-27 18:00:08 [ 357 ] DEBUG : Starting new HTTP connection (4): 172.16.1.5:9001 (connectionpool.py:244, _new_conn)
2026-10-27 18:00:08 [ 357 ] DEBUG : Can't connect to Minio: HTTPConnectionPool(host='172.16.1.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0295e7d750>: Failed to establish a new connection: [Errno 111] Connection refused')) (cluster.py:2521, wait_minio_to_start)
2026-10-27 18:00:09 [ 357 ] DEBUG : Starting new HTTP connection (5): 172.16.1.5:9001 (connectionpool.py:244, _new_conn)
2026-10-27 18:00:09 [ 357 ] DEBUG : http://172.16.1.5:9001 "GET / HTTP/1.1" 200 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:09 [ 357 ] DEBUG : Connected to Minio. (cluster.py:2501, wait_minio_to_start)
2026-10-27 18:00:09 [ 357 ] DEBUG : http://172.16.1.5:9001 "GET /root?location= HTTP/1.1" 404 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:09 [ 357 ] DEBUG : http://172.16.1.5:9001 "PUT /root HTTP/1.1" 200 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:09 [ 357 ] DEBUG : S3 bucket 'root' created (cluster.py:2516, wait_minio_to_start)
2026-10-27 18:00:09 [ 357 ] DEBUG : http://172.16.1.5:9001 "GET /root2?location= HTTP/1.1" 404 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:09 [ 357 ] DEBUG : http://172.16.1.5:9001 "PUT /root2 HTTP/1.1" 200 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:09 [ 357 ] DEBUG : S3 bucket 'root2' created (cluster.py:2516, wait_minio_to_start)
2026-10-27 18:00:09 [ 357 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env --project-name roottestmergetrees3 --file /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml --file /compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/docker-compose.yml up -d --no-recreate') (cluster.py:2980, start)
2026-10-27 18:00:09 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml', '--file', '/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/docker-compose.yml', 'up', '-d', '--no-recreate'] (cluster.py:105, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_node_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_node_with_limited_disk_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_node_with_limited_disk_1 ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : Stderr:Creating roottestmergetrees3_node_1                   ... done (cluster.py:115, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : ClickHouse instance created (cluster.py:2988, start)
2026-10-27 18:00:10 [ 357 ] DEBUG : get_instance_ip instance_name=node (cluster.py:1971, get_instance_ip)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestmergetrees3_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : Waiting for ClickHouse start in node, ip: 172.16.1.6... (cluster.py:2995, start)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestmergetrees3_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/2f70001c8a0de4b9f8a6bc0c15dce138930d07bbfa6bc3b8bcae05bf07927c77/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/2f70001c8a0de4b9f8a6bc0c15dce138930d07bbfa6bc3b8bcae05bf07927c77/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/2f70001c8a0de4b9f8a6bc0c15dce138930d07bbfa6bc3b8bcae05bf07927c77/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/2f70001c8a0de4b9f8a6bc0c15dce138930d07bbfa6bc3b8bcae05bf07927c77/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/2f70001c8a0de4b9f8a6bc0c15dce138930d07bbfa6bc3b8bcae05bf07927c77/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : ClickHouse node started (cluster.py:2999, start)
2026-10-27 18:00:10 [ 357 ] DEBUG : get_instance_ip instance_name=node_with_limited_disk (cluster.py:1971, get_instance_ip)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestmergetrees3_node_with_limited_disk_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : Waiting for ClickHouse start in node_with_limited_disk, ip: 172.16.1.7... (cluster.py:2995, start)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestmergetrees3_node_with_limited_disk_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : http://localhost:None "GET /v1.42/containers/e29df8c13da06fe23dd6606cdca34202ec6dfe64b2a08dc736a538252fca6f1d/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
2026-10-27 18:00:10 [ 357 ] DEBUG : ClickHouse node_with_limited_disk started (cluster.py:2999, start)
2026-10-27 18:00:10 [ 357 ] INFO : Cluster started (test.py:49, cluster)
2026-10-27 18:00:10 [ 357 ] INFO : Starting mock servers unstable_proxy.py,no_delete_objects.py (mock_servers.py:18, start_mock_servers)
2026-10-27 18:00:10 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:False cmd: ['bash', '-c', 'echo aW1wb3J0IGh0dHAuY2xpZW50CmltcG9ydCBodHRwLnNlcnZlcgppbXBvcnQgcmFuZG9tCmltcG9ydCBzb2NrZXRzZXJ2ZXIKaW1wb3J0IHN5cwppbXBvcnQgdXJsbGliLnBhcnNlCgoKVVBTVFJFQU1fSE9TVCA9ICJtaW5pbzE6OTAwMSIKcmFuZG9tLnNlZWQoIlVuc3RhYmxlIHByb3h5LzEuMCIpCgoKZGVmIHJlcXVlc3QoY29tbWFuZCwgdXJsLCBoZWFkZXJzPXt9LCBkYXRhPU5vbmUpOgogICAgIiIiTWluaS1yZXF1ZXN0cy4iIiIKCiAgICBjbGFzcyBEdW1teToKICAgICAgICBwYXNzCgogICAgcGFydHMgPSB1cmxsaWIucGFyc2UudXJscGFyc2UodXJsKQogICAgYyA9IGh0dHAuY2xpZW50LkhUVFBDb25uZWN0aW9uKHBhcnRzLmhvc3RuYW1lLCBwYXJ0cy5wb3J0KQogICAgYy5yZXF1ZXN0KAogICAgICAgIGNvbW1hbmQsCiAgICAgICAgdXJsbGliLnBhcnNlLnVybHVucGFyc2UocGFydHMuX3JlcGxhY2Uoc2NoZW1lPSIiLCBuZXRsb2M9IiIpKSwKICAgICAgICBoZWFkZXJzPWhlYWRlcnMsCiAgICAgICAgYm9keT1kYXRhLAogICAgKQogICAgciA9IGMuZ2V0cmVzcG9uc2UoKQogICAgcmVzdWx0ID0gRHVtbXkoKQogICAgcmVzdWx0LnN0YXR1c19jb2RlID0gci5zdGF0dXMKICAgIHJlc3VsdC5oZWFkZXJzID0gci5oZWFkZXJzCiAgICByZXN1bHQuY29udGVudCA9IHIucmVhZCgpCiAgICByZXR1cm4gcmVzdWx0CgoKY2xhc3MgUmVxdWVzdEhhbmRsZXIoaHR0cC5zZXJ2ZXIuQmFzZUhUVFBSZXF1ZXN0SGFuZGxlcik6CiAgICBkZWYgZG9fR0VUKHNlbGYpOgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiLyI6CiAgICAgICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZSgyMDApCiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgICAgIHNlbGYud2ZpbGUud3JpdGUoYiJPSyIpCiAgICAgICAgZWxzZToKICAgICAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fUFVUKHNlbGYpOgogICAgICAgIHNlbGYuZG9fSEVBRCgpCgogICAgZGVmIGRvX1BPU1Qoc2VsZik6CiAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICBjb250ZW50X2xlbmd0aCA9IHNlbGYuaGVhZGVycy5nZXQoIkNvbnRlbnQtTGVuZ3RoIikKICAgICAgICBkYXRhID0gc2VsZi5yZmlsZS5yZWFkKGludChjb250ZW50X2xlbmd0aCkpIGlmIGNvbnRlbnRfbGVuZ3RoIGVsc2UgTm9uZQogICAgICAgIHIgPSByZXF1ZXN0KAogICAgICAgICAgICBzZWxmLmNvbW1hbmQsCiAgICAgICAgICAgIGYiaHR0cDovL3tVUFNUUkVBTV9IT1NUfXtzZWxmLnBhdGh9IiwKICAgICAgICAgICAgaGVhZGVycz1zZWxmLmhlYWRlcnMsCiAgICAgICAgICAgIGRhdGE9ZGF0YSwKICAgICAgICApCiAgICAgICAgc2VsZi5zZW5kX3Jlc3BvbnNlKHIuc3RhdHVzX2NvZGUpCiAgICAgICAgZm9yIGssIHYgaW4gci5oZWFkZXJzLml0ZW1zKCk6CiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoaywgdikKICAgICAgICBzZWxmLmVuZF9oZWFkZXJzKCkKICAgICAgICBpZiByYW5kb20ucmFuZG9tKCkgPCAwLjI1IGFuZCBsZW4oci5jb250ZW50KSA+IDEwMjQgKiAxMDI0OgogICAgICAgICAgICByLmNvbnRlbnQgPSByLmNvbnRlbnRbOiBsZW4oci5jb250ZW50KSAvLyAyXQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUoci5jb250ZW50KQogICAgICAgIHNlbGYud2ZpbGUuY2xvc2UoKQoKCmNsYXNzIFRocmVhZGVkSFRUUFNlcnZlcihzb2NrZXRzZXJ2ZXIuVGhyZWFkaW5nTWl4SW4sIGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIpOgogICAgIiIiSGFuZGxlIHJlcXVlc3RzIGluIGEgc2VwYXJhdGUgdGhyZWFkLiIiIgoKCmh0dHBkID0gVGhyZWFkZWRIVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > unstable_proxy.py'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:10 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'bash', '-c', 'echo aW1wb3J0IGh0dHAuY2xpZW50CmltcG9ydCBodHRwLnNlcnZlcgppbXBvcnQgcmFuZG9tCmltcG9ydCBzb2NrZXRzZXJ2ZXIKaW1wb3J0IHN5cwppbXBvcnQgdXJsbGliLnBhcnNlCgoKVVBTVFJFQU1fSE9TVCA9ICJtaW5pbzE6OTAwMSIKcmFuZG9tLnNlZWQoIlVuc3RhYmxlIHByb3h5LzEuMCIpCgoKZGVmIHJlcXVlc3QoY29tbWFuZCwgdXJsLCBoZWFkZXJzPXt9LCBkYXRhPU5vbmUpOgogICAgIiIiTWluaS1yZXF1ZXN0cy4iIiIKCiAgICBjbGFzcyBEdW1teToKICAgICAgICBwYXNzCgogICAgcGFydHMgPSB1cmxsaWIucGFyc2UudXJscGFyc2UodXJsKQogICAgYyA9IGh0dHAuY2xpZW50LkhUVFBDb25uZWN0aW9uKHBhcnRzLmhvc3RuYW1lLCBwYXJ0cy5wb3J0KQogICAgYy5yZXF1ZXN0KAogICAgICAgIGNvbW1hbmQsCiAgICAgICAgdXJsbGliLnBhcnNlLnVybHVucGFyc2UocGFydHMuX3JlcGxhY2Uoc2NoZW1lPSIiLCBuZXRsb2M9IiIpKSwKICAgICAgICBoZWFkZXJzPWhlYWRlcnMsCiAgICAgICAgYm9keT1kYXRhLAogICAgKQogICAgciA9IGMuZ2V0cmVzcG9uc2UoKQogICAgcmVzdWx0ID0gRHVtbXkoKQogICAgcmVzdWx0LnN0YXR1c19jb2RlID0gci5zdGF0dXMKICAgIHJlc3VsdC5oZWFkZXJzID0gci5oZWFkZXJzCiAgICByZXN1bHQuY29udGVudCA9IHIucmVhZCgpCiAgICByZXR1cm4gcmVzdWx0CgoKY2xhc3MgUmVxdWVzdEhhbmRsZXIoaHR0cC5zZXJ2ZXIuQmFzZUhUVFBSZXF1ZXN0SGFuZGxlcik6CiAgICBkZWYgZG9fR0VUKHNlbGYpOgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiLyI6CiAgICAgICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZSgyMDApCiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgICAgIHNlbGYud2ZpbGUud3JpdGUoYiJPSyIpCiAgICAgICAgZWxzZToKICAgICAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fUFVUKHNlbGYpOgogICAgICAgIHNlbGYuZG9fSEVBRCgpCgogICAgZGVmIGRvX1BPU1Qoc2VsZik6CiAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICBjb250ZW50X2xlbmd0aCA9IHNlbGYuaGVhZGVycy5nZXQoIkNvbnRlbnQtTGVuZ3RoIikKICAgICAgICBkYXRhID0gc2VsZi5yZmlsZS5yZWFkKGludChjb250ZW50X2xlbmd0aCkpIGlmIGNvbnRlbnRfbGVuZ3RoIGVsc2UgTm9uZQogICAgICAgIHIgPSByZXF1ZXN0KAogICAgICAgICAgICBzZWxmLmNvbW1hbmQsCiAgICAgICAgICAgIGYiaHR0cDovL3tVUFNUUkVBTV9IT1NUfXtzZWxmLnBhdGh9IiwKICAgICAgICAgICAgaGVhZGVycz1zZWxmLmhlYWRlcnMsCiAgICAgICAgICAgIGRhdGE9ZGF0YSwKICAgICAgICApCiAgICAgICAgc2VsZi5zZW5kX3Jlc3BvbnNlKHIuc3RhdHVzX2NvZGUpCiAgICAgICAgZm9yIGssIHYgaW4gci5oZWFkZXJzLml0ZW1zKCk6CiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoaywgdikKICAgICAgICBzZWxmLmVuZF9oZWFkZXJzKCkKICAgICAgICBpZiByYW5kb20ucmFuZG9tKCkgPCAwLjI1IGFuZCBsZW4oci5jb250ZW50KSA+IDEwMjQgKiAxMDI0OgogICAgICAgICAgICByLmNvbnRlbnQgPSByLmNvbnRlbnRbOiBsZW4oci5jb250ZW50KSAvLyAyXQogICAgICAgIHNlbGYud2ZpbGUud3JpdGUoci5jb250ZW50KQogICAgICAgIHNlbGYud2ZpbGUuY2xvc2UoKQoKCmNsYXNzIFRocmVhZGVkSFRUUFNlcnZlcihzb2NrZXRzZXJ2ZXIuVGhyZWFkaW5nTWl4SW4sIGh0dHAuc2VydmVyLkhUVFBTZXJ2ZXIpOgogICAgIiIiSGFuZGxlIHJlcXVlc3RzIGluIGEgc2VwYXJhdGUgdGhyZWFkLiIiIgoKCmh0dHBkID0gVGhyZWFkZWRIVFRQU2VydmVyKCgiMC4wLjAuMCIsIGludChzeXMuYXJndlsxXSkpLCBSZXF1ZXN0SGFuZGxlcikKaHR0cGQuc2VydmVfZm9yZXZlcigpCg== | base64 --decode > unstable_proxy.py'] (cluster.py:105, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:True nothrow:False cmd: ['python', 'unstable_proxy.py', '8081'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:10 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:False cmd: ['bash', '-c', 'echo aW1wb3J0IGh0dHAuY2xpZW50CmltcG9ydCBodHRwLnNlcnZlcgppbXBvcnQgcmFuZG9tCmltcG9ydCBzb2NrZXRzZXJ2ZXIKaW1wb3J0IHN5cwppbXBvcnQgdXJsbGliLnBhcnNlCgoKVVBTVFJFQU1fSE9TVCA9ICJtaW5pbzE6OTAwMSIKcmFuZG9tLnNlZWQoIk5vIGRlbGV0ZSBvYmplY3RzLzEuMCIpCgoKZGVmIHJlcXVlc3QoY29tbWFuZCwgdXJsLCBoZWFkZXJzPXt9LCBkYXRhPU5vbmUpOgogICAgIiIiTWluaS1yZXF1ZXN0cy4iIiIKCiAgICBjbGFzcyBEdW1teToKICAgICAgICBwYXNzCgogICAgcGFydHMgPSB1cmxsaWIucGFyc2UudXJscGFyc2UodXJsKQogICAgYyA9IGh0dHAuY2xpZW50LkhUVFBDb25uZWN0aW9uKHBhcnRzLmhvc3RuYW1lLCBwYXJ0cy5wb3J0KQogICAgYy5yZXF1ZXN0KAogICAgICAgIGNvbW1hbmQsCiAgICAgICAgdXJsbGliLnBhcnNlLnVybHVucGFyc2UocGFydHMuX3JlcGxhY2Uoc2NoZW1lPSIiLCBuZXRsb2M9IiIpKSwKICAgICAgICBoZWFkZXJzPWhlYWRlcnMsCiAgICAgICAgYm9keT1kYXRhLAogICAgKQogICAgciA9IGMuZ2V0cmVzcG9uc2UoKQogICAgcmVzdWx0ID0gRHVtbXkoKQogICAgcmVzdWx0LnN0YXR1c19jb2RlID0gci5zdGF0dXMKICAgIHJlc3VsdC5oZWFkZXJzID0gci5oZWFkZXJzCiAgICByZXN1bHQuY29udGVudCA9IHIucmVhZCgpCiAgICByZXR1cm4gcmVzdWx0CgoKY2xhc3MgUmVxdWVzdEhhbmRsZXIoaHR0cC5zZXJ2ZXIuQmFzZUhUVFBSZXF1ZXN0SGFuZGxlcik6CiAgICBkZWYgZG9fR0VUKHNlbGYpOgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiLyI6CiAgICAgICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZSgyMDApCiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgICAgIHNlbGYud2ZpbGUud3JpdGUoYiJPSyIpCiAgICAgICAgZWxzZToKICAgICAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fUFVUKHNlbGYpOgogICAgICAgIHNlbGYuZG9fSEVBRCgpCgogICAgZGVmIGRvX0RFTEVURShzZWxmKToKICAgICAgICBzZWxmLmRvX0hFQUQoKQoKICAgIGRlZiBkb19QT1NUKHNlbGYpOgogICAgICAgIHF1ZXJ5ID0gdXJsbGliLnBhcnNlLnVybHBhcnNlKHNlbGYucGF0aCkucXVlcnkKICAgICAgICBwYXJhbXMgPSB1cmxsaWIucGFyc2UucGFyc2VfcXMocXVlcnksIGtlZXBfYmxhbmtfdmFsdWVzPVRydWUpCiAgICAgICAgaWYgImRlbGV0ZSIgaW4gcGFyYW1zOgogICAgICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoNTAxKQogICAgICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAiYXBwbGljYXRpb24veG1sIikKICAgICAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgICAgIHNlbGYud2ZpbGUud3JpdGUoCiAgICAgICAgICAgICAgICBiIiIiPD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPEVycm9yPgogICAgPENvZGU+Tm90SW1wbGVtZW50ZWQ8L0NvZGU+CiAgICA8TWVzc2FnZT5JbWEgR0NQIGFuZCBJIGNhbid0IGRvIGBEZWxldGVPYmplY3RzYCByZXF1ZXN0IGZvciB5YS4gU2VlIGh0dHBzOi8vaXNzdWV0cmFja2VyLmdvb2dsZS5jb20vaXNzdWVzLzE2MjY1MzcwMCAuPC9NZXNzYWdlPgogICAgPFJlc291cmNlPlJFU09VUkNFPC9SZXNvdXJjZT4KICAgIDxSZXF1ZXN0SWQ+UkVRVUVTVF9JRDwvUmVxdWVzdElkPgo8L0Vycm9yPiIiIgogICAgICAgICAgICApCiAgICAgICAgZWxzZToKICAgICAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICBjb250ZW50X2xlbmd0aCA9IHNlbGYuaGVhZGVycy5nZXQoIkNvbnRlbnQtTGVuZ3RoIikKICAgICAgICBkYXRhID0gc2VsZi5yZmlsZS5yZWFkKGludChjb250ZW50X2xlbmd0aCkpIGlmIGNvbnRlbnRfbGVuZ3RoIGVsc2UgTm9uZQogICAgICAgIHIgPSByZXF1ZXN0KAogICAgICAgICAgICBzZWxmLmNvbW1hbmQsCiAgICAgICAgICAgIGYiaHR0cDovL3tVUFNUUkVBTV9IT1NUfXtzZWxmLnBhdGh9IiwKICAgICAgICAgICAgaGVhZGVycz1zZWxmLmhlYWRlcnMsCiAgICAgICAgICAgIGRhdGE9ZGF0YSwKICAgICAgICApCiAgICAgICAgc2VsZi5zZW5kX3Jlc3BvbnNlKHIuc3RhdHVzX2NvZGUpCiAgICAgICAgZm9yIGssIHYgaW4gci5oZWFkZXJzLml0ZW1zKCk6CiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoaywgdikKICAgICAgICBzZWxmLmVuZF9oZWFkZXJzKCkKICAgICAgICBzZWxmLndmaWxlLndyaXRlKHIuY29udGVudCkKICAgICAgICBzZWxmLndmaWxlLmNsb3NlKCkKCgpjbGFzcyBUaHJlYWRlZEhUVFBTZXJ2ZXIoc29ja2V0c2VydmVyLlRocmVhZGluZ01peEluLCBodHRwLnNlcnZlci5IVFRQU2VydmVyKToKICAgICIiIkhhbmRsZSByZXF1ZXN0cyBpbiBhIHNlcGFyYXRlIHRocmVhZC4iIiIKCgpodHRwZCA9IFRocmVhZGVkSFRUUFNlcnZlcigoIjAuMC4wLjAiLCBpbnQoc3lzLmFyZ3ZbMV0pKSwgUmVxdWVzdEhhbmRsZXIpCmh0dHBkLnNlcnZlX2ZvcmV2ZXIoKQo= | base64 --decode > no_delete_objects.py'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:10 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'bash', '-c', 'echo aW1wb3J0IGh0dHAuY2xpZW50CmltcG9ydCBodHRwLnNlcnZlcgppbXBvcnQgcmFuZG9tCmltcG9ydCBzb2NrZXRzZXJ2ZXIKaW1wb3J0IHN5cwppbXBvcnQgdXJsbGliLnBhcnNlCgoKVVBTVFJFQU1fSE9TVCA9ICJtaW5pbzE6OTAwMSIKcmFuZG9tLnNlZWQoIk5vIGRlbGV0ZSBvYmplY3RzLzEuMCIpCgoKZGVmIHJlcXVlc3QoY29tbWFuZCwgdXJsLCBoZWFkZXJzPXt9LCBkYXRhPU5vbmUpOgogICAgIiIiTWluaS1yZXF1ZXN0cy4iIiIKCiAgICBjbGFzcyBEdW1teToKICAgICAgICBwYXNzCgogICAgcGFydHMgPSB1cmxsaWIucGFyc2UudXJscGFyc2UodXJsKQogICAgYyA9IGh0dHAuY2xpZW50LkhUVFBDb25uZWN0aW9uKHBhcnRzLmhvc3RuYW1lLCBwYXJ0cy5wb3J0KQogICAgYy5yZXF1ZXN0KAogICAgICAgIGNvbW1hbmQsCiAgICAgICAgdXJsbGliLnBhcnNlLnVybHVucGFyc2UocGFydHMuX3JlcGxhY2Uoc2NoZW1lPSIiLCBuZXRsb2M9IiIpKSwKICAgICAgICBoZWFkZXJzPWhlYWRlcnMsCiAgICAgICAgYm9keT1kYXRhLAogICAgKQogICAgciA9IGMuZ2V0cmVzcG9uc2UoKQogICAgcmVzdWx0ID0gRHVtbXkoKQogICAgcmVzdWx0LnN0YXR1c19jb2RlID0gci5zdGF0dXMKICAgIHJlc3VsdC5oZWFkZXJzID0gci5oZWFkZXJzCiAgICByZXN1bHQuY29udGVudCA9IHIucmVhZCgpCiAgICByZXR1cm4gcmVzdWx0CgoKY2xhc3MgUmVxdWVzdEhhbmRsZXIoaHR0cC5zZXJ2ZXIuQmFzZUhUVFBSZXF1ZXN0SGFuZGxlcik6CiAgICBkZWYgZG9fR0VUKHNlbGYpOgogICAgICAgIGlmIHNlbGYucGF0aCA9PSAiLyI6CiAgICAgICAgICAgIHNlbGYuc2VuZF9yZXNwb25zZSgyMDApCiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoIkNvbnRlbnQtVHlwZSIsICJ0ZXh0L3BsYWluIikKICAgICAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgICAgIHNlbGYud2ZpbGUud3JpdGUoYiJPSyIpCiAgICAgICAgZWxzZToKICAgICAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fUFVUKHNlbGYpOgogICAgICAgIHNlbGYuZG9fSEVBRCgpCgogICAgZGVmIGRvX0RFTEVURShzZWxmKToKICAgICAgICBzZWxmLmRvX0hFQUQoKQoKICAgIGRlZiBkb19QT1NUKHNlbGYpOgogICAgICAgIHF1ZXJ5ID0gdXJsbGliLnBhcnNlLnVybHBhcnNlKHNlbGYucGF0aCkucXVlcnkKICAgICAgICBwYXJhbXMgPSB1cmxsaWIucGFyc2UucGFyc2VfcXMocXVlcnksIGtlZXBfYmxhbmtfdmFsdWVzPVRydWUpCiAgICAgICAgaWYgImRlbGV0ZSIgaW4gcGFyYW1zOgogICAgICAgICAgICBzZWxmLnNlbmRfcmVzcG9uc2UoNTAxKQogICAgICAgICAgICBzZWxmLnNlbmRfaGVhZGVyKCJDb250ZW50LVR5cGUiLCAiYXBwbGljYXRpb24veG1sIikKICAgICAgICAgICAgc2VsZi5lbmRfaGVhZGVycygpCiAgICAgICAgICAgIHNlbGYud2ZpbGUud3JpdGUoCiAgICAgICAgICAgICAgICBiIiIiPD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPEVycm9yPgogICAgPENvZGU+Tm90SW1wbGVtZW50ZWQ8L0NvZGU+CiAgICA8TWVzc2FnZT5JbWEgR0NQIGFuZCBJIGNhbid0IGRvIGBEZWxldGVPYmplY3RzYCByZXF1ZXN0IGZvciB5YS4gU2VlIGh0dHBzOi8vaXNzdWV0cmFja2VyLmdvb2dsZS5jb20vaXNzdWVzLzE2MjY1MzcwMCAuPC9NZXNzYWdlPgogICAgPFJlc291cmNlPlJFU09VUkNFPC9SZXNvdXJjZT4KICAgIDxSZXF1ZXN0SWQ+UkVRVUVTVF9JRDwvUmVxdWVzdElkPgo8L0Vycm9yPiIiIgogICAgICAgICAgICApCiAgICAgICAgZWxzZToKICAgICAgICAgICAgc2VsZi5kb19IRUFEKCkKCiAgICBkZWYgZG9fSEVBRChzZWxmKToKICAgICAgICBjb250ZW50X2xlbmd0aCA9IHNlbGYuaGVhZGVycy5nZXQoIkNvbnRlbnQtTGVuZ3RoIikKICAgICAgICBkYXRhID0gc2VsZi5yZmlsZS5yZWFkKGludChjb250ZW50X2xlbmd0aCkpIGlmIGNvbnRlbnRfbGVuZ3RoIGVsc2UgTm9uZQogICAgICAgIHIgPSByZXF1ZXN0KAogICAgICAgICAgICBzZWxmLmNvbW1hbmQsCiAgICAgICAgICAgIGYiaHR0cDovL3tVUFNUUkVBTV9IT1NUfXtzZWxmLnBhdGh9IiwKICAgICAgICAgICAgaGVhZGVycz1zZWxmLmhlYWRlcnMsCiAgICAgICAgICAgIGRhdGE9ZGF0YSwKICAgICAgICApCiAgICAgICAgc2VsZi5zZW5kX3Jlc3BvbnNlKHIuc3RhdHVzX2NvZGUpCiAgICAgICAgZm9yIGssIHYgaW4gci5oZWFkZXJzLml0ZW1zKCk6CiAgICAgICAgICAgIHNlbGYuc2VuZF9oZWFkZXIoaywgdikKICAgICAgICBzZWxmLmVuZF9oZWFkZXJzKCkKICAgICAgICBzZWxmLndmaWxlLndyaXRlKHIuY29udGVudCkKICAgICAgICBzZWxmLndmaWxlLmNsb3NlKCkKCgpjbGFzcyBUaHJlYWRlZEhUVFBTZXJ2ZXIoc29ja2V0c2VydmVyLlRocmVhZGluZ01peEluLCBodHRwLnNlcnZlci5IVFRQU2VydmVyKToKICAgICIiIkhhbmRsZSByZXF1ZXN0cyBpbiBhIHNlcGFyYXRlIHRocmVhZC4iIiIKCgpodHRwZCA9IFRocmVhZGVkSFRUUFNlcnZlcigoIjAuMC4wLjAiLCBpbnQoc3lzLmFyZ3ZbMV0pKSwgUmVxdWVzdEhhbmRsZXIpCmh0dHBkLnNlcnZlX2ZvcmV2ZXIoKQo= | base64 --decode > no_delete_objects.py'] (cluster.py:105, run_and_check)
2026-10-27 18:00:10 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:True nothrow:False cmd: ['python', 'no_delete_objects.py', '8082'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:10 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:10 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8081/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:11 [ 357 ] DEBUG : Exitcode:7 (cluster.py:117, run_and_check)
2026-10-27 18:00:11 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8082/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:11 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8082/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:11 [ 357 ] DEBUG : Exitcode:7 (cluster.py:117, run_and_check)
2026-10-27 18:00:12 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:12 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8081/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:12 [ 357 ] DEBUG : Exitcode:7 (cluster.py:117, run_and_check)
2026-10-27 18:00:12 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8082/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:12 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8082/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:12 [ 357 ] DEBUG : Exitcode:7 (cluster.py:117, run_and_check)
2026-10-27 18:00:13 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:13 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8081/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:14 [ 357 ] DEBUG : Exitcode:7 (cluster.py:117, run_and_check)
2026-10-27 18:00:14 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8082/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:14 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8082/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:14 [ 357 ] DEBUG : Exitcode:7 (cluster.py:117, run_and_check)
2026-10-27 18:00:15 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:15 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8081/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:17 [ 357 ] DEBUG : Stdout:OK (cluster.py:113, run_and_check)
2026-10-27 18:00:17 [ 357 ] DEBUG : unstable_proxy.py answered OK on attempt 4 (mock_servers.py:53, start_mock_servers)
2026-10-27 18:00:17 [ 357 ] DEBUG : run container_id:roottestmergetrees3_resolver_1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8082/'] (cluster.py:2004, exec_in_container)
2026-10-27 18:00:17 [ 357 ] DEBUG : Command:['docker', 'exec', 'roottestmergetrees3_resolver_1', 'curl', '-s', 'http://localhost:8082/'] (cluster.py:105, run_and_check)
2026-10-27 18:00:19 [ 357 ] DEBUG : Stdout:OK (cluster.py:113, run_and_check)
2026-10-27 18:00:19 [ 357 ] DEBUG : no_delete_objects.py answered OK on attempt 4 (mock_servers.py:53, start_mock_servers)
2026-10-27 18:00:19 [ 357 ] INFO : Mock servers unstable_proxy.py,no_delete_objects.py started (mock_servers.py:68, start_mock_servers)
2026-10-27 18:00:19 [ 357 ] DEBUG : http://172.16.1.5:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:19 [ 357 ] INFO : list_objects (2): ['data/clickhouse_remove_objects_capability_18ad7f67-0b1a-4935-af1a-78b6e3d28652', 'data/clickhouse_remove_objects_capability_772f947a-d715-447d-9739-8005f7825ca9'] (test.py:123, list_objects)
2026-10-27 18:00:20 [ 357 ] DEBUG : http://172.16.1.5:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:20 [ 357 ] INFO : list_objects (1): ['data/bfn/lfyrymtqiiwtoythpdxlgtudbeqzp'] (test.py:123, list_objects)
2026-10-27 18:00:21 [ 357 ] DEBUG : http://172.16.1.5:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=data%2F HTTP/1.1" 200 0 (connectionpool.py:546, _make_request)
2026-10-27 18:00:21 [ 357 ] INFO : list_objects (0): [] (test.py:123, list_objects)
------------------------------ Captured log call -------------------------------
2026-10-27 18:00:21 [ 357 ] DEBUG : Executing query DROP TABLE IF EXISTS s3_test on node (cluster.py:3423, query)
2026-10-27 18:00:21 [ 357 ] DEBUG : Executing query 
        CREATE TABLE s3_test (
            dt Date,
            id Int64,
            data String,
            INDEX min_max (id) TYPE minmax GRANULARITY 3
        ) ENGINE=MergeTree()
        PARTITION BY dt
        ORDER BY (dt, id)
        SETTINGS storage_policy='unstable_s3',old_parts_lifetime=0,index_granularity=512,temporary_directories_lifetime=1 on node (cluster.py:3423, query)
2026-10-27 18:00:21 [ 357 ] DEBUG : Executing query INSERT INTO s3_test SELECT today(), *, toString(*) FROM system.numbers LIMIT 9000000 on node (cluster.py:3423, query)
--------------------------- Captured stderr teardown ---------------------------
WARNING: API is accessible on http://0.0.0.0:2375 without encryption.
         Access to the remote API is equivalent to root access on the host. Refer
         to the 'Docker daemon attack surface' section in the documentation for
         more information: https://docs.docker.com/go/attack-surface/
---------------------------- Captured log teardown -----------------------------
2026-10-27 18:01:36 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml', '--file', '/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:105, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_node_with_limited_disk_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_node_1                   ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_minio1_1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_resolver_1               ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_proxy1_1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_proxy2_1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_node_1                   ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_node_with_limited_disk_1 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_minio1_1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_resolver_1               ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_proxy2_1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Stderr:Stopping roottestmergetrees3_proxy1_1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/logs/stderr.log* || true'] (cluster.py:105, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/logs/stderr.log* || true'] (cluster.py:105, run_and_check)
2026-10-27 18:01:57 [ 357 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/.env', '--project-name', 'roottestmergetrees3', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node/docker-compose.yml', '--file', '/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_merge_tree_s3/_instances_1/node_with_limited_disk/docker-compose.yml', 'down', '--volumes'] (cluster.py:105, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_node_with_limited_disk_1 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_node_1                   ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_minio1_1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_resolver_1               ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_proxy1_1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_proxy2_1                 ...  (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_node_1                   ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_proxy2_1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_node_with_limited_disk_1 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_proxy1_1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_resolver_1               ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing roottestmergetrees3_minio1_1                 ... done (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing network roottestmergetrees3_default (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stderr:Removing volume roottestmergetrees3_data1-1 (cluster.py:115, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Cleanup called (cluster.py:754, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : !!! Docker info: Client: Docker Engine - Community
 Version:    29.9.2
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.38.1
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v5.6.1
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 41
 Server Version: 23.0.6
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: b7a25261e029d68978bbf290df0a62fc819b3c51
 runc version: v1.5.2-0-g29dd3dc2
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.0-130-generic
 Operating System: Ubuntu 22.04.5 LTS (containerized)
 OSType: linux
 Architecture: x86_64
 CPUs: 16
 Total Memory: 30.59GiB
 Name: 7970d9fe2753
 ID: 46b97c99-7c10-4b47-8770-06172c974321
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  65.108.242.32:5000
  127.0.0.0/8
 Registry Mirrors:
  http://65.108.242.32:5000/
 Live Restore Enabled: false
 Default Address Pools:
   Base: 172.17.0.0/12, Size: 24

 (cluster.py:722, print_all_docker_pieces)
2026-10-27 18:01:58 [ 357 ] DEBUG : Docker networks for project roottestmergetrees3 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:733, print_all_docker_pieces)
2026-10-27 18:01:58 [ 357 ] DEBUG : Docker containers for project roottestmergetrees3 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:741, print_all_docker_pieces)
2026-10-27 18:01:58 [ 357 ] DEBUG : Docker volumes for project roottestmergetrees3 are DRIVER    VOLUME NAME
 (cluster.py:749, print_all_docker_pieces)
2026-10-27 18:01:58 [ 357 ] DEBUG : Command:docker container list --all --filter name='^/roottestmergetrees3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : No running containers for project: roottestmergetrees3 (cluster.py:782, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Images pruned (cluster.py:807, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup)
2026-10-27 18:01:58 [ 357 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check)
2026-10-27 18:01:58 [ 357 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check)
============================== slowest durations ===============================
74.31s call     test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]
37.86s setup    test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]
22.81s teardown test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]
=========================== short test summary info ============================
FAILED test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]
======================== 1 failed in 136.12s (0:02:16) =========================
Traceback (most recent call last):
  File "/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration/./runner", line 455, in <module>
    subprocess.check_call(cmd, shell=True)
  File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'docker run   --rm --name clickhouse_integration_tests_zp8ssq --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=1864 -e DOCKER_BASE_TAG=1864 -e DOCKER_KERBERIZED_HADOOP_TAG=1864 -e DOCKER_KERBEROS_KDC_TAG=1864 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=1864 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=1864 -e DOCKER_MYSQL_JS_CLIENT_TAG=1864 -e DOCKER_MYSQL_PHP_CLIENT_TAG=1864 -e DOCKER_NGINX_DAV_TAG=1864 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=1864   -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600  -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 5 -rfEps --run-id=1 --color=no --durations=0 'test_merge_tree_s3/test.py::test_s3_disk_reads_on_unstable_connection[node]'  -vvv" altinityinfra/integration-tests-runner:1864 ' returned non-zero exit status 1.